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Abstract. It is common knowledge that a key dynamical characteristic of 
a network is its spectrum (the collection of all eigenvalues of the network's 
weighted adjacency matrix). In [4] we demonstrated that it is possible to re- 
duce a network, considered as a graph, to a smaller network with fewer vertices 
and edges while preserving the spectrum (or spectral information) of the orig- 
inal network. This procedure allows for the introduction of new equivalence 
relations between networks, where two networks are spectrally equivalent if 
they can be reduced to the same network. Additionally, using this theory it 
is possible to establish whether a network, modeled as a dynamical system, 
has a globally attracting fixed point (is strongly synchronizing). In this pa- 
per we further develop this theory of isospectral network transformations and 
demonstrate that our procedures are applicable to families of parameterized 
networks and networks of arbitrary size. 

Real networks are often very large with a complicated structure (topol- 
ogy). It is therefore tempting to find ways of reducing (or compressing) 
them. However, when a network is compressed it is possible for some of 
the important network properties to be lost. 

As most real networks are dynamic a natural goal, when reducing 
such systems, is to preserve their dynamical characteristics. Arguably, 
the most important characteristic of a dynamical system is its spectrum. 
It may seem "obvious" though, that a reduced (lower-dimensional) net- 
work should necessarily have fewer eigenvalues than the initial unre- 
duced system. If such were true then no such procedure could exist. 

However, in [4 it was shown that this is in fact possible and even easily 
implemented for the analysis of real networks. Moreover, this procedure 
allows those working with real networks the freedom to design any crite- 
ria for compressing a network that they see fit. For instance, one could 
remove all vertices (edges) with minimal centrality, in/outer degree, etc. 
Any general rule that determines a core subnetwork, presumably chosen 
by an expert (biologist, engineer, etc), is possible. 
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The present paper further develops this procedure presenting some 
new results and numerous examples. To make the paper self-contained 
and accessible to non-mathematicians we present all definitions and re- 
sults with examples but omit technical proofs if they can be found else- 
where. 

1. INTRODUCTION 

The study of networks in nature, science, and technology is currently one of the 
most active areas of research. A good deal of this research however is focused on 
the structural or static features of these networks [2 [3 [3 [TUl EJ 021 E] although 
most real networks are inherently dynamic. That is, each network element has an 
associated state that changes with time (e.g. neural networks, metabolic networks, 
etc.). 

Moreover, each such network is characterized by the following features. First, the 
network elements are themselves dynamical systems that evolve according to their 
own intrinsic (internal) dynamics when isolated from the other network elements. 
Second, these network elements interact with one another. This interaction between 
network elements ensures that these elements do in fact form a network. 

The internal dynamics and interactions of a network have already been studied 
together for quite some time. A popular example are reaction-diffusion equations 
where the reaction corresponds to the internal dynamics and the diffusion to the 
interactions of these systems (see [H| for instance). 

What differentiates the current study of dynamical systems from those that 
have been done previously is the focus on the graph structure or topology of the 
network. Using this approach one "freezes" the network dynamics and studies the 
network's structure of interactions (or graph of interactions). These investigations 
have lead to numerous discoveries concerning the structure of networks. However, 
the dynamic characteristics of networks have received far less attention. 

To investigate the dynamic properties of networks a general approach was in- 
troduced in pp. The major idea in this work is that a network's dynamics can be 
analyzed in terms of three key features; (i) the internal (local) dynamics of the 
network elements, (ii) the interactions between the network elements, and (iii) the 
topology or structure of the graph of interactions of the network. 

Features (i) and (ii) of a network are described by dynamical systems and can 
therefore be studied using standard methods in the theory of differential equations 
and dynamical systems (again reaction-diffusion systems serve as a standard ex- 
ample). However, the third feature of a network, its topology, is static and must 
therefore be studied by other means. 

It is worth noting that there is a well developed theory for dynamical networks 
with a lattice type structure of interactions [6]. However, the large majority of real 
networks do not have a regular structure and therefore require another theory to 
describe their dynamics. 

The approach developed in [T] is based on the idea that the third feature of 
a dynamical network, its graph structure, can also be described as a dynamical 
system. This notion has allowed for the development of a fairly general theory 
of dynamical networks. However, we note here that these studies do not consider 
rewirings of dynamical networks. The reason being is that rewiring a network makes 
its law of evolution nonconstant (i.e. time dependent) in which case the network 



ISOSPECTRAL TRANSFORMATIONS OF DYNAMICAL NETWORKS 



3 



can no longer be considered as an autonomous dynamical system. Instead, to study 
rewirings one must consider a dynamical system in a certain space of dynamical 
networks, which is another problem. 

When dealing with real networks one is often confronted with the fact that 
the dynamics of the individual network elements are unknown. Additionally, the 
interactions (and interaction strengths) between network elements may also be un- 
known. Even in such circumstances it is tempting to develop methods to study the 
dynamics of such systems. But this begs the question: If little about the network 
is known what can be deduced? 

In fact, we do know something. That is, we know that the network is dynamic. 
Hence, one may try various transforms of the network's topology that preserve 
important aspects of the network's dynamics. Here we consider one of the most 
fundamental characteristics of a dynamical system, its spectrum. 

In many situations only the network structure is known i.e. which network 
elements interact and which do not. This structure can therefore be modeled by a 
graph of these interactions or equivalently by the adjacency matrix of this graph. 
If the numerical strengths of these interactions are known then we have a weighted 
graph of interactions and a corresponding weighted adjacency matrix. 

Because of the often complicated structure of a network it is tempting to find 
ways of simplifying this structure while preserving some fundamental property or 
feature of the network. For instance, it would be nice if we were able to reduce a 
network onto some subset of its vertices (or edges) while maintaining the spectrum 
of the network's adjacency matrix. However, reducing a network in this way may 
seem impossible since larger matrices have a larger spectrum (number of eigenval- 
ues). 

In fact, it is possible to do just this. The procedure that allows for such reductions 
is called an isospectral graph reduction. This procedure which was developed in [4] 
was moreover shown to have the following key features: 

(1) Easily Implemented: The procedure of isospectral graph reduction is well 
defined and easily implemented. In particular, it is not necessary to develop 
sophisticated software to carry out this procedure as it is both simple and 
straightforward. 

(2) Flexible: The procedure is very flexible allowing experimentalists the pos- 
sibility of reducing a network over any set of network elements (vertices) 
he or she chooses. 

(3) Unique Reductions: After reducing a network it is possible to further 
reduce the network to an even smaller network. Moreover, the resulting 
smaller network does not depend on the intermediate choice of vertices but 
only the final collection (subset) of vertices. 

(4) New Equivalence Relations: This procedure introduces new equiva- 
lence relations between networks where two networks (graphs) are spectrally 
equivalent if they can be reduced to the same network (graph). This in turn 
allows for the introduction of new relations between various networks whose 
topologies look quite different but share similar dynamics. 

(5) Other Network Transforms: It is also possible transform a network in 
a variety of other ways while maintaining the spectrum of the network. 
This includes isospectral expansions of a network which in turn allow for 
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improved estimates of the network's dynamic stability when compared to 
other methods. 

To make the paper self-contained and accessible to the non-mathematician, who 
are dealing with real networks, we give a detailed explanation of an isospectral graph 
reduction and related transformations as well as their important features. These 
key features are illustrated by numerous examples. Proofs of all mathematical 
statements not found in this paper can be found in pQ. 

This procedure, although developed as a practical tool for dealing with real 
networks, has already been shown to be an effective means for obtaining new ad- 
vances in the classical problem of estimating the eigenvalues of a square matrix [3] . 
Specifically, the eigenvalues estimates associated with Gershgorin and others IT3] 
improve as the graph associated with the matrix is reduced. 

In the present paper we strengthen these previous results by applying isospectral 
network transformations to networks of arbitrary size and to families parameter 
dependent networks. Besides this we use a powerful new concept of a complete 
structural set to strengthen and clarify some previously obtained results. 

Lastly, we note that although our procedure deals with matrices as is therefore 
linear in nature, it in fact does not have this restriction and is designed for the 
analysis to nonlinear dynamical systems. 

2. Network as Graphs 

To each network there is an associated weighted directed graph G = (V, E, ui) 
called the network's graph of interactions. The vertex set V represents the elements 
of the network and the edge set E the interaction between these elements. For 
V = {v\, . . . ,v n } we let eij denote the edge from vertex Vi to Vj. The edge eij is 
an element of E if the ith network element interacts with (or influences) the jth 
network element. The function uj gives the edge weights of G where uj(eij), or the 
edge weight of , corresponds to the strength of the interaction between the ith 
and jth elements of a network. We adopt the standard convention that each edge 
of the weighted graph G has a nonzero weight. 

2.1. Isospectral Graph Reductions. In this section we formally describe the 
isospectral reduction process of a graph where each graph is considered to be the 
graph of some dynamical network. Specifically, we consider those graphs that are 
weighted, directed, with edge weights in the set W[A] (defined below). Such graphs 
form the class G. 

Remark 1. The class of graphs G is very general as it contains, for instance, the 
class of undirected graphs with numerical weighs. 

Let C[A] be the set of polynomials in the complex variable A with complex 
coefficients. We denote by W[A] the set of rational functions of the form p/q where 
p, q G C[A], and q ^ 0. As we will be dealing with the eigenvalues of matrices which 
are sets that include multiplicities, we mention the following. 

The element a of the set A that includes multiplicities has multiplicity m if there 
are m elements of A equal to a. If a G A with multiplicity m and a £ B with 
multiplicity n then 

(i) the union A U B is the set in which a has multiplicity m + n; and 

(ii) the difference A — B is the set in which a has multiplicity m — n if to — n > 
and where a A — B otherwise. 
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Definition 2.1. Let W[A] nx ™ denote the set of n X n matrices with entries in 
W[A]. For a matrix A £ W[A]" X ™ suppose that det(A - XI) = p(X)/q(X) where 
p(X),q(X) G C[X]. Define the sets 

P = {X G C : P {X) = 0} and Q = {X G C : q(X) = 0} 

where these sets includes multiplicities. We call the sets 

a (A) = P - Q and o^ 1 (A) = Q - P 

the spectrum (or set of eigenvalues) of A and the inverse spectrum of A respectively. 

We note that both the spectrum of A and the inverse spectrum of A are sets that 
include multiplicities where the multiplicity of each element of o~(A) and a" 1 {A) 
depend on P and Q according to (ii). 

It is worth mentioning that the representation of p(X)/q(X) G W[A] is not unique. 
That is, p(X)/q{X) is equivalent to r(A)/s(A) for p(X), q(X), r(A), s(A) G C[A] if 
p(X)s(X) = q(X)r(X). However, it can be shown that the spectrum and inverse 
spectrum of a matrix A G W[A] nx " are well defined, i.e. do not depend on the 
particular representation of det(A — A/). 

Suppose G = (V, E,uj) with vertex set V — . . . , v n }. We define the matrix 
M(G) G W[A] nx " entry wise by 

M(G%- = cj(e tJ ). 

The matrix M{G) is called the weighted adjacency matrix of G. For the graph G 
we denote by <r(G) and o~~ l (G) the spectrum of and inverse spectrum of M(G) 
respectively. 

The study of digraph spectra has and continues to be an extremely active area 
of research [5]. However, the approach developed in [4], and described here, differs 
from previous studies in that we consider graphs with weights in W[A]. 

The reason we consider graphs with weights in W[A] (or matrices with entries in 
W[A]) is that we wish to reduce the size of the graph (matrix) while maintaining 
its spectrum. We note that this is not possible if we restrict ourselves to matrices 
with numerical weights (entries) since a matrix A G C nx " has exactly n eigenvalues 
including multiplicities. However, a matrix A G W[A]" X ™ may have more than n 
eigenvalues in its spectrum. This is demonstrated in example 2. 

A path P in the graph G — (V,E,lj) is an ordered sequence of distinct vertices 
vi,...,v m G V such that e iji+ i G-Bforl<i<m — 1. We call the vertices 
«2, ■ ■ ■ , »m-i of P the interior vertices of P. If the vertices v\ and v m are the same 
then P is a cycle. A cycle v i . . . , v m is called a loop if m = 1. Note that as Vi, vt is 
a loop of G if and only if en G E we may refer to the edge en as the loop. If S C V 
where V is the vertex set of a graph we will write S = V — S. 

The main idea behind an isospectral reduction of a graph G = (V, E, uj) is that 
we reduce G to a smaller graph on some subset S C V. The sets S for which this 
is possible are defined as follows. 

Definition 2.2. Let G = (V,E,oj). A nonempty vertex set S C V is a structural 
set of G if 

(i) each cycle of G, that is not a loop, contains a vertex in S; and 

(ii) Lo(eu) ^ X for each Vi G S. 

Notice that part (i) of definition 12.21 states that a structural set S of G depends 
intrinsically on the structure of G. Part (ii), on the other hand, is the formal 
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assumption that the loops of the vertices in S, i.e. the complement of S, do not 
have weight equal to A € W[A]. That is, we mean such loops are not weighted by 
the rational function A/1 G W[A]. 

For G G G we let st(G) denote the set of all structural sets of the graph G. 

Definition 2.3. Suppose G — (V,E,u) with structural set S = {vi, . . . ,v m }. Let 
Bij{G] S) be the set of paths or cycles from i?j to Vj with no interior vertices in S. 
We call a path or cycle (3 G Bij(G; S) a branch of G with respect to S. We let 

B S (G) = |J Bij(G; S) 

l<i, j<m 

denote the set of all branches of G with respect to S. 

If P = Vi , . . . , v m is a branch of G with respect to S and m > 2 define 

m-l , s 

For m — 1,2 let V u (f3) — ^(eim)- We call V ul {[3) the branch product of /3. Note that 
assumption (ii) in definition 12.21 implies that the branch product of any (3 £ Bs{G) 
is always defined and is a rational function in W[A]. 

In our procedure, which we term an isospectral graph reduction, we replace the 
branches S) of a graph with a single edge. The following definition specifies 

the weights of these edges. 

Definition 2.4. Let G = (V,E,u) with structural set S = {v\ ...,v m }. Define 
the edge weights 

f ]T P U (P) if By (G; 5)^0 
(2) M e y) = < 0eBij(.G;S) for 1 < i, j < m. 

I otherwise 

The graph 1Zs(G) = (S, E, jS) where ey € f if n{eij) ^ is the isospectral reduction 
of G over 5. 

Observe that jLt(ey) in definition 12.41 is the weight of the edge ey in lZs(G). 
Moreover, as W[X] is closed under both addition and multiplication then the edge 
weights /Lt(ey) of lZs(G) are also in the set W[X]. Hence, the isospectral reduction 
lZs(G) is again a graph in G. 

Example 1. Consider the graph G — (V,E,ui) given in ftgure[J] (left) where each 
edge of G is given unit weight. Note that the vertex set S — {^1,^3} C V is a 
structural set of G since 

(i) the three nonloop cycles of G, namely V\, V2, 1)3, W4, Vi; vi,v$,vi; and vs,vq,V3 
each contain a vertex in S; and 

(ii) the loop weights of vertices in S — {f2, ^4, ^5, are Lo(e22) — 1, ^(644) = 1, 
w(e55) = 1, and Lu(eee) = 1 respectively. Hence, uj(eu) = 1 G W[A] is not equal to 
the rational function A/1 G W[A] for each Vi G S. 

In contrast, the vertex set T — {v\,v§} is not a structural set of G as the (non- 
loop) cycle V3,vq,V3 does not contain a vertex ofT. 

The branches in Bs{G) are respectively B\\{G;S) — {vi,v$,vi\ , Bis(G; S) = 
{vi,v 2 ,v 3 }, B 3 i(G;S) = {v 3 ,i>4,vi} ; andB 33 (G;S) = {v 3 ,v 6 ,v 3 }. Using equation 
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G TZs(G) 

FIGURE 1. Reduction of G over S — {vx,v 3 } where each edge in 
G has unit weight. 



(QP the branch product of each branch is given by 

~Pw(vi,V 5 ,Vl) = Pu)(vi,V2,V 3 ) = V u (v3,V4,Vi) = V U (V3,V 6 ,V 3 ) = - - - , 

Using equation HP each edge oflZs{G) — (S, £, /i) has weight given by 

M(en) = M(ei3) = M(eai) = ^33) = 

As each edge weight is nonzero the edge set £ of1Zs{G) is E — {en, ei3, e^i, 633}. 
The graph 7is(G) is shown in figure\j\ (right). 

Recall that if S is a structural set of the graph G £ G then the isospectral 
reduction lZs(G) is also a graph in G. Hence, both G and TZs(G) have well-defined 
spectra. The relation between the spectrum a(G) and a(TZs(G)) is given in the 
following fundamental theorem. 

Theorem 2.5. Let S be a structural set of the graph G £ G. Then 
a(Tl s (G)) = (a(G) U cr" 1 ^)) - (<r(G\ s ) U a~\G)). 
Since the cycles of G\§ are loops it follows that 

(3) det (M(G\s) - XI) = J] H e a) - A ) ■ 

Vies 

In light of equation Q , theorem 12.51 has the following corollary. 

Corollary 1. Let S be a structural set of the graph G £ G. If M (G) £ C nxn then 

(1) a{G\ § ) = Me u ) : « 4 € 5}; 

fw; «r _1 (G| s ) = 0; and 

fmj a(TZs(G)) = a(G) ~ a(G\§). 

In many applications the graphs (matrices) that are used have real or positive 
weights (entries). If G = (V, E, uj) has complex valued weights and S £ st(G) then 
corollary[T]states that the spectrum of TZs(G) and G differ at most by the spectrum 
of G\g. Moreover, the spectrum a(G\§) are the weights of the loops en for Vi £ S. 

We note that theorem 12.51 describes exactly which eigenvalues we may gain from 
an isospectral reduction and which me may lose. In this way an isospectral reduction 
of a graph preserves the spectral information of the original graph. This will be 
important in section 4 where we consider isospectral reductions that do not effect 
the nonzero eigenvalues of a graph. 
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G G\ s 
Figure 2. Restriction of the graph G to S = {i>2, «4, V5, vq} where 
each edge in G and G\g has unit weight. 



Example 2. Let G be the graph considered in example^ As previously shown the 
vertex set S — {vi,vs} is a structural set of G. Moreover, M(G) G C 6x6 . Hence, 
corollary^ allows us to quickly compute the eigenvalues of the reduced graph lZs(G) 
once the eigenvalues of G are known. 

As one can calculate, the eigenvalues of the graph G are cr(G) = {2, —1, 1, 1, 1, 0}. 
The restricted graph G\g shown in figure^ has loop weights lu(c22) = 1, ^(244) = 1, 
w(e55) = 1, and uj(eee) = 1. Corollary]]] therefore implies that er(G|g) = {1, 1, 1, 1} 
(and a~ 1 (G\ s ) = %). As a(K s (G)) = a(G) - cr(G\§) then the spectrum of the 
reduced graph is o~(7Zs(G)) = {2, — 1, 0}. 

Since the graph IZs(G) has two vertices the matrix M(lZs(G)) G W[A] 2x2 . How- 
ever, notice that 

\3 _ \ 2 _ 9 \ 

det (M(K S (G)) XI) = - _ i 

which is zero for A = 2,-1,0. This is an explicit demonstration of the fact that an 
nxn matrix in W[A]" X ™ may have more than n eigenvalues. 

Therefore, the effect of reducing G over S is that we lose the eigenvalues {1, 1, 1}. 
However, even if o~(G) is unknown we still know the following. The set of eigenval- 
ues o~(G\g) — {1, 1, 1, 1} is the most by which cr(lZs{G)) and o~(G) can differ. 

We note that both a(G\§) and a~ 1 (G\g) are easily calculated via equation ((3|). 
Therefore, theorem [2?5] offers a quick way of computing the eigenvalues of a reduced 
graph if the spectrum of the original unreduced graph is known. 

2.2. Sequential Reductions. In section 2.1 we observed that any reduction lZs(G) 
of a graph G G G is again a graph in G. It is therefore possible to consider sequen- 
tial reductions of a graph G G G. However, this requires that we first extend our 
notation to sequences of isospectral reductions. 

For G = (V,E,lj) suppose S m C S m -i C • • • C Si C V such that Si G st(G), 
Hi{G) =K Sl (G) and 

S i+ i G st(Ki{G)) where ft s<+1 (ft;(G)) - K i+ i(G), 1 < i < m- 1. 

If this is the case we say Si, ... , S m induces a sequence of reductions on G with 
final vertex set S m . By way of notation we write lZ m (G) = 1Z(G; Si, ... , S m ) where 
1Z(G; Si, . . . , S m ) denotes the graph G reduced over the vertex set Si then S2 and 
so on until G is reduced over the final vertex set S rn . 

If S ^ st(G) it is natural to ask whether there exists a sequence of vertex sets 
satisfying S C S m -i ^ ■■■ C Si C V that induce a sequence of reductions on G 
and if so is this the only such sequence? To answer these questions we note the 
following. 
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If the weight uj(eu) ^ A for some Wj G V then the vertex set S = V — {vi} is a 
structural set of G. This follows from the fact that S = {vi}. Hence, the graph 
G\g is the graph restricted to the single vertex v\. In particular, this implies that 
any cycle of G\§ is a loop. 

Therefore, any graph GeG can be reduced over the structural set S = V — {vi} 
if it is known that u>(ea) 7^ A. Another way to state this is that it is possible 
to remove the vertex Vi from G via an isospectral reduction if tu(eu) 7^ A without 
knowing anything about the graph structure of G. This has the following important 
implication. 

Suppose it is known that no loop of G or any loop of any sequential reduction 
of G has weight A. If this is the case then it is possible to remove any sequence of 
single vertices from G via a sequence of isospectral reductions. Therefore, G can 
be sequentially reduced to a graph on any subset of its vertex set. This idea is the 
motivation behind the following. 

For any polynomial p G C[A] let deg(p) denote the degree of p. If w — p/q G W[A] 
where p, q G C[A] let 

ir(w) = deg(p) - deg(q). 
Let W^A] be the subset of W[A] given by 

W ff [A] = {we W[A] : ir(w) < 0}. 

That is, W^A] is the set of rational functions in which the degree of the numerator 
is less than or equal to the degree of the denominator. Let G v be the graphs in G 
with edge weights in the set W ff [A]. 

Lemma 2.6. If G G G„- and S G st(G) then TZs{G) G G T . In particular, no loop 
of G and no loop of any reduction of G can have weight A. 

By the reasoning above, if G G then G can be (sequentially) reduced to a 
graph on any subset of its vertex set. This result is stated in the following theorem. 

Theorem 2.7. (Existence of Isospectral Reductions Over any Vertex Set) 

Let G = (V, E,uS) be graph in G v and suppose V is a nonempty subset of V. Then 
there exist sets V C S m -i C ••• C Si C V such that Si, . . . , S m —i,V induces a 
sequence of reductions on G. 

For G G it is therefore possible to reduce a graph G G to a graph on 
any (nonempty) subset of vertex set via some sequence of isospectral reductions. 
Moreover, such reductions have the following uniqueness property. 

Theorem 2.8. (Uniqueness of Isospectral Reductions Over any Vertex 
Set) Let G = (V,E,lj) be graph in G w and suppose V is a nonempty subset ofV. 
If Si, ... , S m -i, V and Ti, . . . , T n -i, V both induce a sequence of reductions on G 
thenK(G;Si,...,S m -i,V)=K(G;Ti,...,T n _i,V). 

The results of theorem 12.71 and theorem 12.81 allow for the following definition. 

Definition 2.9. Let G — (V, E, to) be graph in G ff . If V C V is nonempty define 

n v [G]=n{G;Si,...,S m -i,V) 

where Si, ... , S m _i, V is any sequence that induces a sequence of reductions on G 
with final vertex set V. 
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~R-{vi,V2,v 4 }(G) A 3 — A 

Figure 3. Distinct sequences of isospectral reductions with the 
same final vertex set and outcome. 



The graph 1Z\> [G] is well defined as a result of theorems !2 . 71 and !2 . 81 The notation 
7?.y[G] given in definition 12.91 is intended to emphasize the fact that V need not be 
a structural set of G. 

Remark 2. Note that tt(c) = for any c G C. Hence, if M (G) G C nxn then 
G G Gtt. Therefore, any graph with complex weights can be uniquely reduced to a 
graph on any nonempty subset of its vertex set. This is of particular importance 
for the estimation of spectra of matrices with complex entries in [3] . 

Example 3. Let G = (V,E,uj) be the graph shown in figured Our goal is to 
reduce G over the vertex set {1)1,1)4} C V. Note that as G G G T theorem \2. 7| 
guarantees that there is at least one sequence of reductions that reduces G to the 
graph TZ {vuVi} [G}. 

In fact there are exactly two. This follows from the fact that {1)1,1)4} ^ st(G). 
Hence, G cannot be reduced over {vi,v 4 } with a single reduction. However, any 
(nontrivial) reduction of G removes at least one vertex from G. 

Therefore, the two possible ways of reducing G over the vertex set {v\,v 4 } are 

(4) 1Z {vuVi} [G] =1Z(G;{v 1 ,V2,v 4 },{v 1 ,v 4 }); and 

(5) K {vijVi y[G] =1l(G;{vi,V3,v i },{vi,v i }). 

Both of the reductions given in |^J) and $5}) are shown in figure The dashed 
arrows labeled TZt in this figure represent the reduction of a graph over some struc- 
tural set T. This notation is meant to emphasize that this diagram commutes. That 
is, 

T^{v u v 4 } {'^■{v 1 ,v 2 ,v 4 }{G)) = 1Z{ Vl . Vi } (TZ{ VljV3}Vi y(G)) 
as guaranteed by theorem \2.8l 

2.3. Equivalence Relations. Theorem 12.71 and theorem 12.81 assert that a graph 
G G Gjr has a unique reduction to any (nonempty) subset of its vertex set via some 



ISOSPECTRAL TRANSFORMATIONS OF DYNAMICAL NETWORKS 



11 




7t T (G)[G] — TZ t (h)[H] 

Figure 4. G and H are equivalent under the relation induced by 
the rule r given in example 2] 



sequence of isospectral reductions. In this section this property will allow us to 
define various equivalence relations on the graphs in — 0. 

Two weighted digraphs G\ = (Vi, E\, uji), and Gi — (Vi, Ei,u3-z) are isomorphic 
if there is a bijection b : V\ —¥ V2 such that there is an edge in G\ from Vi to Vj if 
and only if there is an edge e,-j between b(vi) and b(Vj) in G2 with (^(ey) = ^>i{fiij)- 
If the map b exists it is called an isomorphism and we write G\ ~ G2 ■ 

An isomorphism is essentially a relabeling of the vertices of a graph. Therefore, 
if two graphs are isomorphic then their spectra are identical. 

Theorem 2.10. (Spectral Equivalence) Suppose for any graph G — (V,E,ui) 
in &„■ — that t is a rule that selects a unique nonempty subset t(G) C V . Then 
t induces an equivalence relation ~ on the set G w — where G ~ H if the graph 

n T{G) [G]~n r{H) [H]. 

Two graphs may look very different but be spectrally equivalent, in which case 
the corresponding networks have similar dynamics. Choosing an appropriate rule 
r can help discover this similarity. 

Example 4. Let G = (V, E,ui). For Vi £ V let c(vi) be the number of cycles in G 
that contain Uj. If c ma x(G) = max„ iE vc(«j) let 

(G)/2}. 

Observe that for each graph G £ G w — the set t(G) both exists and is unique. 
Thus the relation of having an isomorphic reduction with respect to this rule induces 
an equivalence relation on G n — 0. 

In figure^ the graphs G and H have the vertex set t(G) — {wi,«2} = T {H)- 
As shown in the figure, the graph TZ T ^[G] ~ H-t(h) [H] ■ Hence, G ~ H under the 
relation ~ induced by the rule t. 

Importantly, choosing a rule that selects a unique vertex set of each graph allows 
one to study the graphs in — modulo some particular graph feature. (In 
example H] this graph feature or vertex set are the vertices that are part of less than 
Cmax(G)/2 cycles of G.) This allows experimentalists the opportunity to compare 
the reduced topology of various networks which have been reduced over any subset 
of network elements deemed important in the particular research field or by a 
particular researcher. 
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3. Weight Preserving Isospectral Transformations 

The isospectral graph reductions introduced in section 2 modify not only the 
graph structure but also the weight set of a graph. That is, if 1Zs(G) = (S, £, /i) is 
any reduction of G = (V,E,u) then typically u>(E) ^ ft(£), i.e. 

EE}^ { M ( 

e ij) '■ e ij 

This may lead one to assume that this procedure simply shifts the complexity of 
the graph's structure to its set of edge weights. However, this is not the case. 

In this section we introduce graph transformations that modify the structure of 
a graph but preserve the weights of the graph's edges. As before, the procedure 
preserves the spectrum of the graph up to a known set. Such transformations are 
of particular importance in section 4.2 where dynamical network expansions are 
discussed. 

The idea behind an isospectral graph transformation that preserves a graph's 
edge weights is simple enough. If two graphs G, H £ G have the same branch 
structure (including weights) then they should have similar spectra. 

To make this precise suppose G — (V,E,w) and S £ st(G). If the branch 
P = v\, . . . ,v m E Bs(G) let ^g(/3) be the ordered sequence 

G (/3) = w(ei 2 ), . . . ,u;(ei-i !i ),u}(e ii ),oj(e it i + i), . . . , uj(e m -i, m )- 

for m > 1 and u>(eu) if m = 1. 

Let G,H E G. Suppose S — {v±, . . . , v m } is a structural set of both G and H. 
The branch set Bij(G; S) is isomorphic to Bij(H; S) if there is a bijection 

b:B ij (G;S)^B ij (H;S) 

such that Qg(P) — ^H{b(P)) for each (3 £ Bij(G; S). If such a map exists we write 
B i: j(G; S) ~ Bij(H; S). If 

Bij(G; S) ~ B i:j (H] S) for each 1 < i,j < m 

we say Bs{G) is isomorphic to Bs{H) and write Bs{G) ~ Bs{H). 

Definition 3.1. If 5 1 is a structural set of both G,H £ G and Bs(G) ~ Bs(H) we 
say G is a weight preserving isospectral transformation of iJ over S*. 

Example 5. Suppose H and G are the graphs in figure^ Note that the vertex set 
S = {vi,vs} is a structural set of both H and G. Moreover, 

Bu(H- S) = {vi,w 2 ,vx}, B\\{G\ S) = {vx,v 5 ,vx}; 

Bi 3 (H; S) = {vi,w 2 ,v 3 }, Bi 3 (G; S) = {vi,v 2 ,v 3 }; 

B 3 i(H; S) = {v 3 , iu 4 , ui}, B 3 i(G; S) = {v 3 , u 4 , vi}; 

B 33 (H; S) = {v 3 , w 2 ,v 3 }, B 33 (G; S) = {v 3 ,v 6 ,v 3 }. 

Note that the branch ft = {v\,v^,Vx\ in B\\(G; S) has the weight sequence given 
by Qg{/3) = 1,1,1- Similarly, the branch 7 = {vx,w 2 ,Vx} in Bu(H;S) has the 
weight sequence £^(7) = 1, 1, 1. Hence, Bu(H; S) ~ Bn(G; S). Continuing in this 
manner, one can check that each Bij(H; S) ~ Bij(G; S) for i,j £ {1, 3}. Therefore, 
Bs{H) ~ Bs{G) or G is a weight preserving isospectral transformation of H over 
S. 

Remark 3. We note that if Bs(H) ~ Bs(G) the graphs G and H need not be 
isomorphic (see example [5]). 
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Figure 5. The graph G is a isospectral expansion of the graph H 
with respect to the structural set S — {wijUs}. 



As Bs{G) ~ Bs{H) implies that 1Zs{G) = TZs(H) we have the following corollary 
to theorem 12.51 

Corollary 2. If the graph G is a weight preserving isospectral transformation of 
H over S then 

{a(G)Ua-HG\s))-(a(G\ s Ua-\G)) = (a(H)Ua-'(H\ s ))-(a(H\ s Ua-HH)). 

For G G G and S G si(G) suppose a — vi,...,v m and /3 = u\,...,u n are 
branches in Bs(G). These branches are said to be independent if 

{v 2 , v m -i} n {u 2 , u„-i} = 0. 

That is, a and /3 are independent if they share no interior vertices. 

Definition 3.2. Let G, H G G and 5 G st(G), st(.ff'). Suppose 

(i) B S (G) ~ B r (#); 

(ii) the branches of Bs(H) are independent; 

(hi) each vertex of G and if belongs to a branch of Bs{G) and Bs{H) respectively. 
Then we call H an isospectral expansion of G with respect to S. 

Isospectral expansions are particular types of weight preserving isospectral trans- 
formations and moreover are unique up to a labeling of vertices. Therefore, any two 
expansions of G with respect to S are isomorphic. By slight abuse of terminology 
we let Xs{G) be any representative from the set of isospectral expansions and call 
Xs(G) the isospectral expansion of G with respect to S. 

Theorem 3.3. Let G = (V,E,uj) with structural set S. Then the graph G and its 
isospectral expansion Xs(G) have the same set of edge weights. Moreover, 

det (M(X S (G)) - XI) = det (Af(G) - XI) JJ ( w ( e «) ~ A )™ 1 ' 1 

ViEV-S 

where is the number of branches in B$(G) containing U^. 

Example 6. Consider the graph G — (V,E,u) and H — (V,£ ,fx) in figure^ As 
demonstrated in example^ if S — {vi,v 3 } then the branch set B${G) ~ Bs(H). 
Moreover, it can be seen from figure^ that the four branches of Bs(G) share no 
interior vertices. That is, the branches of Bs(G) are pairwise independent. Lastly, 
each vertex of G belongs to at least one branch of Bs(G). 

Therefore, the graph G is an isospectral expansion of H with respect to S or 
G = Xs(H). Importantly, note that the edge weights of H and its expansion G are 
identical, i.e. the sets oj(E) and //(£) are both {!}. 
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Moreover, observe that the vertex W2 of H is an interior vertex of the branches 
Vi,W2,Vi; vi,W2,V3 € Bs (H) . Similarly, the vertex W4. of H is an interior vertex of 
the branches U3, 104,^3; V3,Wi,Vi € Bs{H). As io{e22) — 1 and w(e44) = 1 theorem 
HO implies that a(X s (H)) = a(H) U {1, 1}. 

We note that G — Xs{H) in figure^ is the graph G in figure^ Hence, o~(G) 
{'1. 1.1.1.1. 1) > implying a(H) = {2,-1,1,0}. 

The principle idea behind an isospectral expansion is the following. If G G G and 
S 6 st(G) then the set of branches Bs(G) is uniquely defined. However, there are 
typically many other graphs H with the same branch structure as G, i.e. S G st(H) 
such that B S {H) ~ B S {G). 

An isospectral expansion of G over S is then a graph H = X$(G) with identical 
branch structure but with the following restriction: The branches of Bs{H) are 
pairwise independent and every vertex of H belongs to a branch in Bs(H). That 
is, any vertex of S in H is part of exactly one branch in Bs{H). 

Hence, given a graph G and structural set S we can algorithmically construct the 
expansion Xg{G) as follows. Start with the vertices S. If /3 € Bij(G; S) then both 
Vi,Vj € S. Construct a path (or cycle) from to Vj with weight sequence fi(/3) 
with new interior vertices. By new we mean vertices that do not already appear on 
the graph we are constructing. Repeat this for each /? 6 By (G; S) . The resulting 
graph is the isospectral expansion Xg{G). 

Importantly, an isospectral expansion is only one example of an isospectral graph 
transformation that preserves the weight set of a graph. Many other weight pre- 
serving isospectral transformations are possible. Moreover, other isospectral graph 
transformations that modify the weight set of a graph but restrict these weights to 
a particular subsets of W[A] are also possible (see [4]). 



As mentioned in the introduction, the dynamics of a network can be analyzed 
in terms of three key features; (i) the internal (local) dynamics of the network 
elements, (ii) the interactions between the network elements, and (iii) the topology 
or structure of the graph of interactions of the network. 

To study the dynamics of networks our first task is to establish a mathematical 
framework for the investigation of networks as dynamical systems. This is done 
following the approach given in p] . 

Let i G I = {1, . . . , n} and T{ : X; —> X, be maps on the complete metric space 
(Xi, d) where 



Let (T,X) denote the direct product of the local systems (Ti,Xi) over X on the 
complete metric space {X, d max ) where for xjeX 

d m ax{x,y) = max{c?(x i ,y i )}. 

Definition 4.1. A map F : X —> X is called an interaction if for every j £ X there 
exists a nonempty collection of indices Xj C X and a continuous function 



4. Networks as Dynamical Systems 



(6) 



Li = sup 



d(Ti(xi),Ti(yi)) 
d(x l ,y i ) 



< 00. 



F . :0.V < X 
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that satisfies the following Lipschitz condition for constants Ay > : 



(7) 



for all x, y £ X where is the restriction of x e X to © iez Then the 
{interaction) map F is defined as follows: 

F(x)j = F,-(x| r .), iel, ie^. 

Definition 4.2. The superposition F = F o T generates the dynamical system 
(J 7 , X) which is a dynamical network. 

n where 



The constants Ay in definition 14.11 form the Lipschitz matrix A 6 1 
the entry Ay = if i ^ Z, ■ . 

Remark 4. Suppose the interaction F : X — s- X is continuously differentiable and 
each Xj C R. If DF is the matrix of first partial derivatives of F then the constants 

Ay =max|(£)F) ii (x)| 
satisfy condition (J7J for the interaction F. 



Definition 4.3. Let F : X 

V = {vi,...,v n }, E = {e lj 
the graph of interactions of F . 



> X be an interaction. The graph Tp = (V, F,w) with 
i G Xj, j € I}, and w(ey) = 1 for ey € F is called 



We note that each vertex i>j € V of the graph IV = (V, F, w) corresponds to the 
ith component (coordinate) of the dynamical network (F, X). Moreover, there is 
an edge ey e F if and only if the j'th coordinate of the interaction F(x) depends 
on the ith coordinate of x. 

Example 7. Let F : [0, l] 4 — > [0, l] 4 be the parameterized interaction given by 



(8) 



F(x;a) = 



1 — acciX4 
1 — axixs 
1 — CXX2X3 
1 — CXX1X3 



for a € [0, 1]. 



Using the Lipschitz constants Ay = max^^ | (DF) ji (x) \ the interaction F has the 
Lipschitz matrix 



(9) 



A 



a a 

0a 

a a 

a 



a 

a 




TTie graph of interactions IV of F is the graph shown in figured (left). 

4.1. Stability of Dynamical Networks. In this section we give sufficient condi- 
tions under which a dynamical network (F, X) has simple dynamics. By simple we 
mean that the system (F, X) has a globally attracting fixed point. 

Definition 4.4. The dynamical network (F, X) has a globally attracting fixed point 
x e X if for any x e AT, 

lim (f OTaa: (F fc (x),x) = 0. 
If (J 7 , X) has a globally attracting fixed point we say it is globally stable. 
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Recall that the constants Li and Ay come from (j6]) and for the local systems 
(T, X) and interaction F respectively. For the dynamical network (F, X) we define 
the matrix Mjr = A T ■ diag[Li, . . . , L n ]. Hence, 



/ AuLi . . . A„iL„ 



\ Ai n Ia . . . A nn L n 
Let p(Mjr) denote the spectral radius of the matrix A, i.e. if o~{Mjr) are the 
eigenvalues of A then 

p{Mr) =max{|A| : A £ cr(Mjr)}. 

Theorem 4.5. If p(MjA < 1 then the dynamical network (F,X) has a globally 
attracting fixed point. 

In the following example we consider a parameterized dynamical network and 
describe how the network's stability depends on this parameter. 

Example 8. Let Ti : [0,1] — > [0,1] be the map Ti(xj) = sin(7rai) for 1 < i < 4. 
One can check that the constant Li = n satisfy for each local system Ti . 

Let F : [0, l] 4 — > [0, l] 4 be the interaction given by (E). Using the Lipschitz 
matrix A given by (0) the matrix 

an an an 
an 
an an an 
an 



As one can compute p{Mjr) — Ian implying that the dynamical network (F,X) has 
a globally attracting fixed point for any parameter value a < l/2n. 

4.2. Dynamical Network Expansions. In this section we consider whether it is 
possible to transform a dynamical network while maintaining the dynamic prop- 
erties of the network. Our goal is to show (i) that such transformations exist and 
are analogous to the graph expansion in section 3 and (ii) that these transforms 
allow for improved estimates on whether the original (untransformed) dynamical 
network has a unique global attractor. 

As defined in section 4 a dynamical network T = F o T is the composition of 
the network's local dynamics T and the interaction F. However, if the system has 
no local dynamics, i.e. T = id is the identity map, then the dynamical network T 
is simply the interaction F. 

Conversely, any composition J- — F o T can be considered to be an interaction. 
Writing T — (F o T) o id the dynamical network (F, X) is simply the interaction 
F = F o T with no local dynamics. 

Remark 5. If (F, X) is considered as a dynamical network with no local dynamics 
then M.jr = A for any constants Ay satisfying ([7|) for F. Hence, (F, X) has a 
globally attracting fixed point if p(A) < 1. 

Without loss in generality for the remainder of this section we consider (F, X) 
to be a dynamical network with no local dynamics. That is, the component 



Fj ■ : Xi ->• X for 1 < j < n. 
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Alternatively we write 

^•(xli,) = J r j(x jl , . . . , x jm ), where lj = {ji, . . . ,j m }. 

Note that if we replace the variable ir^ of J 7 ,- by the function /(yi, . . . , tjk) the result 
is the function 

having variables xj i: . . . ,Xj i _ 1 ,y\, . . . ,yk, Xj i+1 %j m ■ Additionally, if the se- 
quence 7 = £i , . . . , £n let 

^r,ji x h i ■ ■ ■ > ^jm) = 3 7 j( x ji,2> • • • ' x Jto<7)- 
That is, the variables of the function J 7 ^ are indexed by the sequences ji,£i, . ■ . ,£n 
for 1 < i < m. 

Definition 4.6. For G = (V, E,lo) let S G st(G). The set 5 is a complete structural 
set of G if 

(i) each cycle of G, including loops, contains a vertex in S; 

(ii) Lo(ea) ^= A for each Vi G S 1 ; and 

(hi) each vertex of V belongs to a branch of Bs(Tj^). 

The difference between a structural set and a complete structural set of a graph 
G is the following. If S is simply a structural set of G then loops of G need not 
contain a vertex of S. However, if S is a complete structural set of G then every 
cycle of G including loops contains a vertex in S. Moreover, each vertex of the 
graph must belong to some branch of Z?s(r>). 

For G G G let sto(G) denote the set of all complete structural sets of G. Also, if 
the complete structural set S — {vi, . . . , v m } let Is — {1, • • • , m} denote the index 
set of S. 

Definition 4.7. For S G st Q (Tjr) the set 

(10) As(J r ) = {ti,...,t N :v ei ,...,v iN €B s (Tr), N>2} 
is the set of admissible sequences of T with respect to S. 

Let (J 7 , X) be a dynamical network with graph of interactions Tjr = (V, E, lu) 
and suppose S G st (T^). For j G Is let be the function 

•^3 = ^j' ( X ii ) • • ■ ) X jm ) 

in which each variable Xj e is replaced by Xj e j if ^ Is- 
For i > 1 let •Fy.j) be the function 

= { x 2 1 > • • • ' x 7 t ) 

in which each = xe lt ...^ N is replaced by the function Ji l!7 if £i ^ X5. If £1 G Is 
for each 1 < £ <t then define (As-7 7 ).,- = .F/j^-ix. 

Let 7 = ^1, . . . ,f jv € As (J"). For 1 < i < |t_| = N define the N - 2 spaces 

Ai ;7 = A^ . 

Additionally, define the functions 

^~S^i;^{ x i— 1,7) = ^i— 1,7* 

By way of notation we let 

(11) Ajv_i i7 = Xy, XsFn-i^ = Xs^ii and x li7 = . 
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Figure 6. The graph of interactions Tjr and Tx s r of (J 7 , X) and 
(XsJ-, Xs) in example |H1 



Definition 4.8. Suppose S € sto(IV). Let 

X s T = ( XsF ^) ® ( <Wn) ■ 

1<»<|7| 

and 

^ = (©x i )e( 

iex s 7e-4s(^) 

Ki<|7| 

The dynamical network (A5 J 7 , X5) is called the dynamical network expansion of 
(J-,X) with respect to S*. 



Example 9. Consider the dynamical network (J 7 , X) where 



J-(x) 



J"i (aii, £4) 
•^(zi,^) 
•^3(^2,^3) 
74(^1,^4) 



As this network has the same form as the dynamical network in example [?] it has 
the graph of interactions Tjr = (V, E,u)) shown in figure\E[ (left). Moreover, the set 
S = {i>i,t>3} is a complete structural set of Tjr. To see this note that the cycles of 
Tjr form the set 

{ui,Ui;U3,t!3;t)i,i; 4 ,Ui;Ui,t;2,«3;f3)V4,Ui;V3,«2,f3} 

As (i) each cycle of Tjr contains either v± or V3 and (ii) each vertex in V belongs 
to the path v\, V2, V3 or V3, U4, v\ then S £ st$(Tjr). Hence, the expansion (AgJ 7 , X) 
is well defined. 

To construct this expansion we first consider the components of J- indexed by 
Ts = {1,3}. For J- 1 — J-\(x\, X4) note that 2; 4 is indexed by an element not in T$. 
Hence, = Fi(xi, £41). Replacing xu by the function = .F2 (a; 141, £341) 

yields J~{i.2) = F&(xi&t, £341)). Since each variable of 7(1,2) * s indexed by a 

sequence beginning with an element of Is then 

X S F\ = 7" 4 (xi4i,X34i)). 



Similarly, the function XsFs can be sh 



own to be 
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As As(J-) = {121, 123, 321, 323} then for any 7 € As{F) there is a single func- 
tion Afg-7-2,7 corresponding to 7 given by 

XsFj(xi) — Xi for 7 = i,2,j. 

Following definition \4-8\ the expansion XsJ 7 is given by 

T\ (xi , Fa (#141 , £341 )) 
J 7 3(J 7 2(xi23, X323), x 3 ) 

Xl 
Xi 

X3 
X3 

where X$ — (Ai © A 3 ) © (A141 © A341 © A123 © A323) The graph of interactions 
Tx s jr is shown in figure^ (right). 

Note that the isospectral expansion Xs(Tjr) = Tx s r- This is in fact true in 
general. 

Proposition 1. Suppose that (XsJ 7 ,Xs) is a dynamical network expansion of 
(F,S). ThenX s {Tr)=T Xs r. 

A natural question to ask is whether the expansion (XsJ 7 , Ag) and the initial 
dynamical network (J 7 , X) have similar dynamics. 

Theorem 4.9. Suppose (XsJ 7 ,Xs) is a dynamical network expansion of {T,X). If 
(XsJ 7 , Xs) has a globally attracting fixed point then (J 7 , A) has a globally attracting 
fixed point. 

The following is an immediate corollary to theorem 14.91 and remark [3] 

Corollary 3. Let (A5J 7 , Ag) be a dynamical network expansion of (J-,X). Suppose 
the constants Ajj satisfy ^ for XsJ-. If p(A) < 1 then (J 7 , A) has a globally 
attracting fixed point. 

The question then is whether there is any advantage in considering a dynamical 
network expansion over the original unexpanded network. As it turns out, dynam- 
ical network expansions always allow for better estimates (or at least no worse) of 
a dynamical network's global stability. 

Theorem 4.10. (Improved Stability Estimates for Dynamical Networks) 

Let (XsJ- \Xs) be a dynamical network expansion of (J 7 , A). Suppose there exist 
constants Ay satisfying for J 7 . Then there are constants Ay satisfying ^Tty for 
XsJ 7 such that p(k) < p(A). 

Example 10. Let (J 7 , A) be the dynamical network given in example\Bi considered 
as a network without local dynamics. Hence, 

for a e [0, 1] 



(12) 



X s J 7 (x) 



XsJ 7 i(xi,Xm,X34l) 

AsJ" 3 (:El23,2;323,:£3) 

XsJ 7 i4l(xi) 

^5^123(^1) 

XsFsil (x 3 ) 

XsJ 7 323(X3) 



1 — a sin(7ra;i ) sin(-7nr4) 
1 — a sin(7rxi ) sin(7ra;3) 
1 — a sin (77x2) sin (7^3) 
1 — a sin(7ra;i ) sin(7rX3) 



where X = [0, l] 4 . 
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Note that the system (J 7 , X) has the same form as the dynamical network in 
example^ Hence, for S = {v\,V3} the expansion (XsJ- ,Xs) given by equation 
is 

XsT{x] a) = 



(13) 



Letting Aj 



A 



1 — a sin(7rxi) sin [a7r(l — sin(7rai2i) sin(7ra:32i))] 
1 — a sin [cr7r(l — sin(7ra;i23) sin(7ra323))] sin(7r;r3) 

Xl 
Xi 
X3 

max ie x s \(DXsJ-)ji(x.)\ one can compute that 












XsTxax 




XsFita 




XsF^i 




Xs^323 





an sin(aTr) 


an sin(a7r) 


an sin(a7r) 




for a < 1/2 



an sin(a7r) 


an sin(a7r) 


an sin(a7r) 

where the rows (and columns) of A are numbered as in equation US\) . The spectral 
radius of A is then given by 

2 sin(a7r) 



1 














1 1 







P(A) 



an 



v/34 - 2 cos(2a?r) 



As p(A) < 1 for a < 0.185 then theorem \4-. 10\ implies (J 7 , X) has a globally attracting 
fixed point for any parameter a < 0.185. Since l/2n < 0.185 then this is better than 
the estimate gained by direct analysis of(J-,X) in example^ 

As a final example we consider a dynamical network of arbitrary size. To deter- 
mine the stability of this system we require the following. For A e W[A]™ xn define 
the sets 



E 



Then all eigenvalues of A are 



£{A) = \J{XeC:\X-A u \< 
i=i 

Theorem 4.11. (Gershgorin 9 \) Let A e C nx; 

contained in the set £ (A). 

Let A e W[A] nx ™ be the adjacency matrix of the graph G. For S £ st a {G) we 
say S £ sto(A) and let As be the adjacency matrix of the reduced graph lZs(G). 
The following theorem is an improvement of Gershgorin's result for estimating the 
nonzero eigenvalues of a complex valued matrix. 

Theorem 4.12. Let A £ C" xn . If S £ sto(A) then the nonzero eigenvalues of A 
are contained in the set £(As). Moreover, £{A$) C £{A). 

Proof. Let A £ C nx ™ be the adjacency matrix of the graph G. For S £ sto(A) 
suppose A s — A s {\) £ W[A]^. Then equations (JXJ) and imply the ij'th entry 
of As(X) has the form 

m — 1 



A s (X) t] = £ A 12 J] 

PeBij(G,S) k=2 



A 



k,k+l 

"A 
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where the sum is taken over all branches of the form /3 = Vi, . . . , v m - Hence, for any 
nonzero eigenvalue a £ cr(A) the matrix As(a) £ C ixe . Moreover, a £ a(As(Xj) 
by corollary 1 implying a £ a (As (a)). 

By an application of Gershgorin's theorem the inequality 

i 

\a-A s (a)u\< E \ A s(a)ij\ 

holds for some 1 < i < £. Hence, a £ £(As). 

To verify that the region £(As) C £(A) let S — {v n -i-i, v n -i, . . . , v n }. For 
Sk = {vk+i, Vk+2, • ■ • , v n } note that Si £ st (A) and £(A Sl ) = (J™ =2 R t where 



^ = {A€C:|A-(^ + ^i)|< K 
and An = 0. The claim then is Ri C £i U £^ where 



£i = {XeC: \X-Au\ < E for l<i< 

To see this suppose X £ Ri for fixed A £ C and 2 < i < n. Hence, 



|(A-^)-^|< E + 

j=2,j^i 



By use of the triangle and reverse triangle inequality then 

A A n n 

\x-M-\^p\< E mw + E 

Collecting like terms, this implies 



AnAu , ^ ^ , A , , \ | AgAij 



AnA 



ia-^i + iaiI^ E i^ii+E 

If A ^ f i then |A - A u \ > implying 

\X-A ll \ + \A l i\<\X~A u \ + L^J2\Ai J \. 

Therefore, \Au\ ^ and |A| < X)"= 2 IAjI- Since = thcn A e ^i- This verifies 
the claim that Ri C £ i U £^ implying £ C £(^4). 

Note that each entry of As ± (X)ij = AnAij/X is defined at A 7^ 0. Therefore, 
the same argument can be used to show £((As 1 )s 2 ) ^= £(Asi)- Continuing in this 
manner it follows that £{A$) C £(A) since by theorem 12.81 the reduced matrix 
A s = (((A Sl )...) Sn _ e _ 2 )s- □ 

Theorem 14.121 can used to estimate the spectral radius associated with an ex- 
panded dynamical network. From a computational point of view this can be espe- 
cially useful when the system size is large as is shown in the following example. 

Example 11. Consider the dynamical network (J-,X) given by 
J : ,[.r, |..r, .,i = cos (^~Xj_iX j+ ^J 1 < j < 2n 
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where X — [0, l] 2 ™ and n > 2. Here, the indices are taken mod 2n and the system 
is assumed to have no local dynamics. Observe that the graph Tjr = (V, E, uj) 
shown in figure 7 (left) for n = 2 has a nearest neighbor structure of interactions 
with periodic boundary conditions. 

[ ~, for i = j ± 1 
As max\(DJ : )ji(x)\ = < 4v/2 ~ ' th e matrix 

x ^ x otherwise 



A = 





7T 

4^2 
4V2 



4\/2 





4V2 



4\/2 



4\/2 





is a Lipschitz matrix of ( J 7 , X). 

Since A has constant row sums given by s = -k /2^/2 then s is an eigenvalue of 
A corresponding to the eigenvector [1 . . . 1] T 6 R 2nxl . However, s > 1 so theorem 
\4-5\ does not directly provide any conclusion about the dynamical network (J 7 , X). 

However, S — {«2, «4, • ■ • V2n} is a complete structural set ofTjr since S is a 
structural set of Tjr and IV has no loops. Moreover, as 



(14) 



Ss(I>) = {vi,Vj,v k :iel s , j = i± l,k = j± 1} 



where each index is taken mod 2n then each vertex of IV belongs to a branch of 

Note that if j € Is then j ± 1 ^ Is- Replacing the variables Xj-\ and 0/ 
.Fj by Xj-ij and Xj+i j respectively results in the function 

^{0,1) = ^ii^-lj ^ x j+hj)- 

Since the variables Xj-ij and Xj+i,j of Fu,\) are indexed by sequences begin- 
ning with elements not in Is then they are replaced by F}_i a -_i,j and J~j+i-.j+i.j 
respectively to form J^Oj^) ■ Hence, 

F{j,2) = Fj (Fj-l (Xj-2,j-l,j , l,j ) ; ^Fj + l ( x j,j+l J , X J+ 2, 3 + l,j)) 

As j G Is implies j ± 2 € Is then each variable of Ftj^) is indexed by a sequence 
beginning with an element of Is- This in turn implies that XsJ-j = Tups f or 

jel s . 

As Bs{Tjr) is given by \1J$ then 

As{F) = {», J, k : i € I s , 3 = i ± 1, k = j ± 1} 

where each index is taken mod 2n and n > 2. For each i, j, k = 7 £ ^4s(F") f/iere is 
i/ien a single function corresponding to 7 where 



^3^2,2 ■ X-l-j -t X 2 -2 given by XsT^^v) 
By use of ill]) this function can be written as XsJ r - y (xi) = 



X 2 y 



Following definition 
given by 



the dynamical network expansion XsT : Xs — > Xs is 
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^214 



V4U 




V 3 ^232 V 4 32 

Figure 7. The graph of interactions IV and Tx s r of (J 7 , X) and 
(XsJ-, Xs) in example [TT] for n = 2. 



«434 











XsFln, 1,2 


(15) 


^ s J-(x) = 




e 





where 



XsFk,i,m{xk) = £fc /or kj,m e AsiJ 7 ) and 
<%s>J = cos cos (^-a;j_2j-i, 
/or j S {2, 4, . . . , 2n}. Moreover, the space 



71 

^ = (0^i)©( X 



TTie graph of interactions T^ s _f is shown in figure 7 (right) for n=2. 
Letting Ajj = max xe x s K^^S-^ 7 )^^)! one can compute that 



V j els, ie.A s (.F) 

1 /or j — k,l,m; i = k 

otherwise 



To compute the spectral radius of A note </ia< i/ G is i/ie graph with adjacency 
matrix A i/ien S € sio(G), i.e. S* 6 sto(A). See /igure[2| (7e/fJ. Moreover, for n > 2 
£/ie n x n matrix 



Ac = 



2a/A a/A 
a/A 2a/A 

a/A 



a/A 



'■• a/A 

a/A 2a/A 



where a — 



tt 2 sin(vr/4\/2) 
16\/2 ' 



For n = 2 £/ie graph TZs{G) is shown in figure^ (right) having the adjacency matrix 

A s = 



2a/A 2a/A 
2a/A 2a/A 
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«232 V432 U 434 

G 

Figure 8. The weighted graph G and reduced graph lZg(G) for 
n = 2. 




£(A) £(A S ) 

Figure 9. The regions £ (A) and £ (As) from example 11, where 
the unit circle is indicated by the dashed lines. 



Using theorem \4.12\ the nonzero eigenvalues of A are contained in the region 

£(A S ) = {A € C : |A - 2a/X\ < 2\a/X\}. 

It therefore follows that p(A) < « .95 < 1 implying p(lZg(G)) < 1. 

By theorem \2.5\ then (XgJ 7 , X$) has a globally attracting fixed point. Hence, the 
original unreduced system (J 7 , X) also has this property as well by theorem \4-9\ 
Note that if one uses the region £(A) (i.e. Gershgorin's original theorem [9],) one 
can only estimate that p(A) < 2. See figure 9. 

We note that the method used in example 11 can be used in general for de- 
termining the stability of dynamical networks. To summarize, once a matrix A 
corresponding to (Xg J 7 , Xg) has been found one can use the reduced matrix Ag to 
estimate p(A) via theorem 14. 121 

Importantly, we note that the method of using network expansions generalizes 
the standard approach used for determining whether a network has a unique global 
attractor. As a final observation, in this section, we note that it is possible to 
sequentially expand a dynamical network and thereby sequentially improve ones 
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estimate of whether the original (untransformed) network has a globally attracting 
fixed point. 

5. Concluding Remarks 

The large majority of real world networks are dynamic. Yet most studies deal 
only with the structure (topology) of these networks. As the spectrum is an impor- 
tant dynamical aspect of a network, isospectral graph transformations provide a 
way of studying the interplay between the topology of a network and its dynamics. 

As a tool for investigating networks, isospectral transformations are quite flex- 
ible. Isospectral transformations can be used to reduce or expand the size of a 
network, considered as a weighted graph, while either modifying or maintaining 
the edge weights of the network. These isospectral graph reductions and isospectral 
graph expansion have the following useful properties and applications. 

Isospectral graph reductions allow one the ability to uniquely reduce a network 
to any subsets of its vertex set while preserving the network spectrum. This in turn 
allows for the introduction of new equivalence relations on the space of all networks 
where two networks are equivalent if they can be reduced to the same network via 
some rule. 

From the point of view of applications, such rules can be devised by experi- 
mentalists to compare different networks modulo some specific network structure. 
However, this requires the expertise of the experimentalist (biologist, physicist, 
etc.) to determine an appropriate set of network elements over which to reduce 
the network. Our procedure, therefore allows the expert the ability to devise and 
compare different network reductions, i.e. to compare different reduced networks 
corresponding to various reduction criteria. Such reduction criteria can be designed 
with respect to vertex or edge centrality, in/out degree, or any other network char- 
acteristic that is deemed important. 

Isospectral graph expansions can also be used to enlarge a network while preserv- 
ing its sets of edge weights. As a general multi-dimensional dynamical system has 
an associated graph structure (i.e. can be considered to be a dynamical network) 
it is also possible to use this procedure to expand such systems while preserving 
their dynamics. This can be done in various ways and can, in particular, be used 
to establish whether the system, e.g. dynamical network, has a globally attracting 
fixed point. 

The new notions, results, and examples presented in this paper demonstrate that 
the theory of isospectral network transformations is applicable to larger class of net- 
works (e.g. parameter dependent networks) than previously considered. However, 
we are confident that our approach can be developed even further. For instance, 
this approach is equally applicable to time-delayed networks (in progress). 
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